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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . This communication is responsive to 07/06/10 . 

2. The allowed claim(s) is/are 1, 4, 5, 8, and 11-20 . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) □ All b)DSome* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1. 84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . □ Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. □ Information Disclosure Statements (PTO/SB/08), 

Paper No./Mail Date 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. □ Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. ^ Examiner's Amendment/Comment 

8. ^ Examiner's Statement of Reasons for Allowance 

9. □ Other . 
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DETAILED ACTION 

EXAMINER'S AMENDMENT 

1 . An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1 .312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
with applicant's representative, Philip S. Lyren on 09/27/10. 
The application has been amended as follows: 

Claims 6, and 7 have been cancelled and claims 1, 8,11, and 14 have 
been amended as follow: 

1 . A method of automatic speech recognition (ASR), comprising: 
receiving a speech utterance from a user; 
assessing resources , bv a processor , by monitoring both port 
utilization and processing utilization of each of a plurality of different ASR 
engines to determine which of the plurality of different ASR engines are 
busy serving users; 

assigning the speech utterance to a single ASR engine when the 
plurality of different ASR engines are busy such that the port and 
processing utilizations are within a set of threshold va l u e values ; 
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assigning the speech utterance to the plurality of different ASR 
engines when the plurality of different ASR engines are not busy such that 
the port and processing utilizations are within a another set of threshold 
vo l uo values; and 

generating text of the speech utterance with either the single ASR 
engine or the plurality of different ASR engines; 

wherein assigning the speech utterance to a single engine if 
processing utilization is within a threshold value when the port 
utilization of the single ASR engine is lower than a port utilization 
threshold of 80%. 

8. An automatic speech recognition (ASR) system comprising: 

means for processing a digital input signal from an utterance of a 

user; 

means for evaluating resources of the ASR system to determine 
whether the ASR system is busy processing utterances of users by 
monitoring port utilization and available processing power of each of a 
group of ASR engines; and 

means for selecting between a single ASR engine and the group of 
ASR engines to recognize the utterance of the user, wherein the moans 
fef selecting means utilizes the evaluation of resources to select the 
single ASR engine when the port utilization and available processing 
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power are within a set of threshold va l u e values and the ASR system is 
busy processing the utterances of the users and to select the group of 
ASR engines when the port utilization and available processing power are 
within another set of threshold values and the ASR system is not busy 
processing the utterances of the usersj. 

wherein selecting the group of ASR engines to recognize the 
utterance of the user if available processing power is within a 
threshold value when the port utilization of two ASR engines is lower 
than a predefined threshold of 75 %. 

14. A system, comprising: 

a computer system comprising a central processing unit 
coupled to a memory and resource management application; and 

a plurality of different automatic speech recognition (ASR) 
engines coupled to the computer system, wherein the resource 
management application assesses resources being used by each 
of the plurality of different ASR engines by monitoring port 
utilization and available processing power of each of the plurality of 
different ASR engines, and the computer system select a single 
ASR engine to analyze a speech utterance when the system is 
busy such that the port utilization and the available processing 
power are within a set of threshold va l ue values and selects 
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multiple ASR engines to analyze the speech utterance when the 
system is not busy such that the port utilization and the available 
processing power are within another set of threshold values; 

wherein selecting a single ASR engine to analyze the 
speech utterance if available processing power is within a 
threshold value when the port utilization of the single ASR 
engine is lower than a port utilization of 80%. 

In claiml 1 , line 1 , replace "combing" by -combining-. 

Allowable Subject Matter 

2. Claims 1 , 4, 5, 8, and 1 1 - 20 are allowed over the prior art of record. The 
following is an examiner's statement of reasons for allowance: 

After further search and thorough examination of the present application and in 
view of he Applicant's arguments and Appeal brief filed on 07/06/1 0, pages 11 - 1 7; 
claims 1,4,5, 8, and 1 1 - 20 are found to be in condition for allowance over the prior art 
made of record. 

As to claims 1 , 4, and 5, neither Keiller nor Lo et al., nor Bennett et al., nor 
Johnson nor Birkestrand et al., nor Watanabe et al., teach or suggest assessing 
resources, by a processor, by monitoring both port utilization and processing utilization 
of each of a plurality of different ASR engines to determine which of the plurality of 
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different ASR engines are busy serving users; assigning the speech utterance to a 
single ASR engine when the plurality of different ASR engines are busy such that the 
port and processing utilizations are within a set of threshold values; assigning the 
speech utterance to the plurality of different ASR engines when the plurality of different 
ASR engines are not busy such that the port and processing utilizations are within a 
another set of threshold values; generating text of the speech utterance with either the 
single ASR engine or the plurality of different ASR engines; wherein assigning the 
speech utterance to a single engine if processing utilization is within a threshold value 
when the port utilization of the single ASR engine is lower than a port utilization 
threshold of 80%. 

These limitations in conjunction with other limitations of the dependent and 
independent claims were not shown by, would not have been obvious over, nor would 
have been fairly suggested by the prior art of record. 

As to claims 8,11-13, neither Keiller nor Lo et al., nor Bennett et al., nor 
Johnson nor Birkestrand et al., nor Watanabe et al., teach or suggest means for 
evaluating resources of the ASR system to determine whether the ASR system is busy 
processing utterances of users by monitoring port utilization and available processing 
power of each of a group of ASR engines; and means for selecting between a single 
ASR engine and the group of ASR engines to recognize the utterance of the user, 
wherein the selecting means utilizes the evaluation of resources to select the single 
ASR engine when the port utilization and available processing power are within a set of 
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threshold values and the ASR system is busy processing the utterances of the users 
and to select the group of ASR engines when the port utilization and available 
processing power are within another set of threshold values and the ASR system is not 
busy processing the utterances of the users; wherein selecting the group of ASR 
engines to recognize the utterance of the user if available processing power is within a 
threshold value when the port utilization of two ASR engines is lower than a predefined 
threshold of 75 %. 

These limitations in conjunction with other limitations of the dependent and 
independent claims were not shown by, would not have been obvious over, nor would 
have been fairly suggested by the prior art of record. 

As to claims 14-20 neither Keiller nor Lo et al., nor Bennett et al., nor Johnson 
nor Birkestrand et al., nor Watanabe et al., teach or suggest a plurality of different 
automatic speech recognition (ASR) engines coupled to the computer system, wherein 
the resource management application assesses resources being used by each of the 
plurality of different ASR engines by monitoring port utilization and available processing 
power of each of the plurality of different ASR engines, and the computer system select 
a single ASR engine to analyze a speech utterance when the system is busy such that 
the port utilization and the available processing power are within a set of threshold 
values and selects multiple ASR engines to analyze the speech utterance when the 
system is not busy such that the port utilization and the available processing power are 
within another set of threshold values; wherein selecting a single ASR engine to analyze 
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the speech utterance if available processing power is within a threshold value when the 
port utilization of the single ASR engine is lower than a port utilization of 80%. 

These limitations in conjunction with other limitations of the dependent and 
independent claims were not shown by, would not have been obvious over, nor would 
have been fairly suggested by the prior art of record. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 

Conclusion 

3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to LEONARD SAINT CYR whose telephone number is 
(571)272-4247. The examiner can normally be reached on Mon- Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571) 2727602. The fax phone 
number for the organization where this application or proceeding is assigned is (571)- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
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Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Leonard Saint-Cyr/ 
Examiner, Art Unit 2626 



